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Adaptive point-based elastic image registration 



5 The present invention relates to the field of digital imaging. In particular, 

the present invention relates to a method of registering a first image and a second 
image, to an image processing device and to a software program for registering a first 
image and a second image. 

The goal of image registration, for example, in medical imaging 

10 applications, is to compensate for differences in images, for example, due to patient 
movements, different scanner modalities, changes in the anatomy etc. Global 
registration methods such as rigid or affine transformations often cannot cope with local 
differences. A solution for such is an elastic registration. Robust elastic registration of 
medical images is a difficult problem, which is currently a subject of intensive research. 

15 One can generally distinguish between three approaches to elastic registration: point- 
based elastic registration, surface-based elastic registration, and voxel-based elastic 
registration. 



20 It is an object of the present invention to provide for a robust elastic 

image registration. 

According to an exemplary embodiment of the present invention as set 
forth in claim 1, the above object may be solved by a method of registering a first 
image and a second image, wherein the first image is assumed as being of elastic 

25 material, such that it has an elasticity. A similarity between the first image and the 

second image is determined. Then, a force field is determined, which, when applied to 
the first image, increases the similarity. In other words, the first image is assumed to be 
elastic and forces are applied to points or portions of the first image, such that 
corresponding points in the first and second images are registered essentially on each 

30 other. Hence, the similarity between the images is increased. 

Advantageously, this may allow for a robust automated registration of 
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the first and second images. 

According to another exemplary embodiment of the present invention as 
set forth in claim 2, at least one parameter of the force field is determined, such that the 
similarity is maximized. 
5 Advantageously, by optimizing parameters of the force field, for 

example, a local influence of individual control points, i.e. points where forces of the 
force field act on the force field, is optimized. As compared to landmark-based 
interpolation schemes, such control points are not mutually dependent. 

According to another exemplary embodiment of the present invention, at 
10 least one parameter relating to the elasticity of the first image is determined or varied 
such that the similarity is maximized. 

According to another exemplary embodiment of the present invention as 
set forth in claim 4, at least one of a force strength of at least one force of the force 
fields, a force direction of at least one force of the forces of the force fields, at least one 
15 location where at least one force of the force fields acts on the first image, a form of at 
least one force of the force fields, a standard deviation of a Gaussian force applied as at 
least one force of the forces of the force fields and a Poisson ratio are optimized such 
that the similarity is maximized. 

In other words, the registration problem is reduced to the problem of 
20 optimizing the parameters of the force fields. 

According to another exemplary embodiment of the present invention as 
set forth in claim S, a very efficient maximization of the similarity is provided, which 
may allow for a robust registration. 

According to another exemplary embodiment of the present invention as 
25 set forth in claim 6, the method is applied to computed tomography slices (CT slices) 
from a follow-up study in radiotherapy planning (adaptive RTF). 

According to another exemplary embodiment of the present invention as 
set forth in claim 7, an image processing device is provided, allowing for a robust 
registration of first and second images based on the assumption that a force field, for 
30 example, existing of Gaussian-shaped forces are applied at several points to the first 
image and an optimization of parameters of this force field. 

According to another exemplary embodiment of the present invention as 
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set forth in claim 8, a computer program is provided, allowing for an improved 
registration of a first image and a second image. The computer program may be written 
in any suitable programming language, such as C-H- and may be stored on a computer 
readable device, such as a CD-ROM. However, the computer program according to the 
5 present invention may also be presented over a network, such as the Worldwide Web, 
from which it may be downloaded, for example, into the internal memory of a 
processor. 

It may be seen as the gist of an exemplary embodiment of the present 
invention that the source image is assumed as being of elastic material, and that a 

10 locally distributed force field, for example, of Gaussian-shaped forces is applied at 
several points in the source image. Then, a variation or optimization of parameters of 
the force field, such as the points where the forces act on the image and the strengths, is 
performed, such that the similarity between the first and second images is increased or 
maximized. Advantageously, this may allow to improve a point-based registration 

15 paradigm by simultaneously finding optimal positions of the control points, i.e. points 
where the forces act on the image, in the image, as well as optimizing the local 
influence of individual control points. As compared to landmark-based interpolation 
schemes, the control points according to an exemplary embodiment of the present 
invention are not mutually dependent, which may potentially result in a 

20 computationally more efficient registration approach. 

These and other aspects of the present invention will become apparent 
from and elucidated with reference to the embodiments described hereinafter. 

Exemplary embodiments of the present invention will be described in the 
following, with reference to the following drawings: 

25 



Fig. 1 shows a schematic representation of an image processing device 
according to an exemplary embodiment of the present invention, adapted 
to execute a method according to an exemplary embodiment of the 
30 present invention. 

Fig. 2 shows a simplified flow-chart of an exemplary embodiment of a 
method according to the present invention. 
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Fig. 3 shows registration results with nine force application points 
achieved with an exemplary embodiment of the method according to the 
present invention. 

5 

Fig. 1 depicts an exemplary embodiment of an image processing device 
according to the present invention, for executing an exemplary embodiment of a 
method in accordance with the present invention. The image processing device depicted 
in Fig. 1 comprises a central processing unit (CPU) or image processor 1 connected to a 

10 memory 2 for storing the first and second images, parameters of the force field, a 
similarity value and for example, a deformation required to the source image to be 
registered on the reference image. The image processor 1 may be connected to a 
plurality of input/output network or diagnosis devices such as an MR device or a CT 
device, or an ultrasonic scanner. The image processor is fiuthermore connected to a 

15 display device 4 (for example, a computer monitor) for displaying information or 
images computed or adapted in the image processor 1 . An operator may interact with 
the image processor 1 via a keyboard S and/or other input/output devices which are not 
depicted in Fig. 1. 

In spite of the fact that the method is described in the following with 

20 reference to medical applications, in particular applications in adaptive radio therapy 
planning (RTF), it should be noted that the present invention can be applied to any 
multi-dimensional data sets or images required to be registered. For example, the 
present invention may be applied to quality testing of products, where images of actual 
products are compared to images of reference products. Also, the method may be 

25 applied for material testing, for example, for monitoring changes to an object of interest 
over a certain period of time. 

Fig. 2 shows a flow-chart of an exemplary embodiment of a method for 
registering a first and a second image according to the present invention. 

As may be taken from Fig. 1, after the start in step SI, the source image 

30 is assumed as being elastic with a certain elasticity in step S2. Then, in the subsequent 
step S3, a similarity is determined between the source image and the reference image. 
Then, in the subsequent step S4, a force field is applied to the source image. The 
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parameters of the force field are subsequently varied in the subsequent step S5, such 
that the similarity between the source image and the reference image is maximized. 
Then, in the subsequent step S6, a deformation required to the source image to be 
registered on the reference image is determined on the basis of the optimized 
5 parameters of the force field. Then, the method continues to step S7, where it ends. 

The above method is described in fiirther detail in the following. 

As mentioned above, in step S2, the source image is assumed as being an 
elastic medium. The most simple model which may be applied to deform the image is 
governed by the equation of linear elasticity (Navier's equation): 

10 

Aui + ^^V(V • u) = -Hil±il)Fi, i = 1,2,3, 



where w,- and Ft are the components of the displacement and of the force 
fields, V is the Poisson ratio, and E is the Young modulus. Typically, the Navier 

15 equation is solved numerically by the finite differences or the finite element method. 
However, for some special types of forces, according to another exemplary embodiment 
of the present invention, analytical solutions may be applied. Several spline-based 
registration approaches which may be applied according to exemplary embodiments of 
the present invention, based on the analytical solutions are known, for example, from 

20 M.H. Davis, A. Khotanzad, D.P. Flaming, and S.E. Harms. A physics-based coordinate 
transform for 3-D image matching. IEEE Transactions on Medical Imaging, 16(3):317- 
328, June 1997; J. Kohlrausch, K. Rohr, and H.S. Stiehl. A new class of elastic body 
splines for non-rigid registration of medical images. In In Proc. Workshop 
Bildverarbeitung in derMedizin 2001, pages 164—168, L'ubeck, Germany, March 

25 2001, which are both hereby incorporated by reference. 

According to an exemplary embodiment of the present invention, 
Gaussian-shaped forces are applied at several points in the source image. For a 
Gaussian force 
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the analytical solution of the Navier equation is given, in accordance 
with E. Gladiline. Theoretische und experimentelle Untersuchung der linearelastischen 
S Randelementmethode zur Registrierung medizinischer Bilder. Diploma thesis. 
University of Hamburg, 1999, which is hereby incorporated by reference as: 



where 



10 



and is a unit vector pointing in the direction of the radius-vector r. 

According to an exemplary embodiment of the present invention, the 
force field is determined, which maximizes a certain similarity measure between the 
15 source image and the reference image. One application scenario of the present invention 
is, for example, as already mentioned above, adaptive radiation therapy planning (RTP), 
where several CT scans of the same patient are taken in order to track anatomical 
changes during treatment. For such cases, a squared difference between the images is an 
appropriate similarity measure. However, the squared difference or also other similarity 
20 measures, e.g. mutual information or cross-correlation may be used for other 
application scenarios. 

Assumed the squared difference between the images as similarity 
measures, the following equation allows a parameter minimization, which maximizes a 
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similarity measure A/ between the images: 



arg max^ M(/,(x),r(p,f(p),a(p).»')(/,(x))) 




where Vis the image domain, // and T(Is) denote intensities of the target 



and transformed source image, and p is the vector of points where the Gaussian forces 
5 are applied, a is the standard deviation and v is the Poisson ratio x is a coordinate. 



force is defined using a displacement ur = 0 of a selected control point, as expressed by 
the following equation: 



invention, the optimization problem can be formulated as searching for optimal 
positions of a given a set of control points pi in the source image, and their optimal 
displacements. Also, according to a variant of this exemplary embodiment of the 
present invention, a standard deviation o, of the Gaussian force applied at /-th control 
1 5 point Pi and the Poisson ratio v as additional parameters. The Yoimg modulus E may, 
according to a further variant of this exemplary embodiment of the present invention, 
be considered as a proportionality coefficient between the force and the displacement. 



influence of each control point pi as well as for using optimal elastic material properties 
20 with respect to the elasticity of the source image. As mentioned above the above 

formulated optimization problem may be solved using standard numerical optimization 
techniques, such as, for example, the downhill simplex method as described in J. A. 
Nelder and R. Mead. A simplex method for function minimization. Computer Journal^ 
(7): 308-313, 1965, which is hereby incorporated by reference. 
25 In Fig. 3, exemplary images of applying the above method to CT slices 

from a follow-up RTP study are shown. For initialization, 9 force application points 
were arbitrarily placed into the source image. In the bottom row of Fig. 3, the 
unregistered and registered difference images are shown. The left side of the bottom 
row shows the unregistered difference image and the right side of the bottom row 



According to an exemplary embodiment of the present invention, the 




10 



Thus, according to the above exemplary embodiment of the present 



The above described approach allows for an adaptive control of local 



wo 2005/057495 



8 



PCT/IB2004/052711 



shows the registered image. The top row shows the source image on the left side and 
the target image on the right side. As may be taken from the registered difference image 
(right image in the bottom row), a good registration result may be achieved. 

Advantageously, the present invention as described above improves the 

5 point-based registration paradigm by simultaneously finding optimal positions of the 
control points in the images, as well as optimizing the local influence of individual 
control points. As compared to landmark-based interpolation schemes, the control 
points in the method according to the present invention are not mutually dependent, 
which may potentially result in a computationally more efficient registration approach. 

10 The present registration concept may potentially be realized using alternative physical 
models, such as, for example, fluid dynamics. 

It should be noted that in spite of the fact that the above invention was 
described with respect to CT images, the present invention may also be applied to 
magnetic resonance images (MRI), positron emitted tomography images (PET), single 

15 photon emission computed tomography images (SPECT) or ultrasound modalities (US). 
Also, other data sets may be used. 



